Intrinsic dimension

It roughly correspond to “how many variables we need to describe the data”. For instance, if all data points lie on a line, we just need a single number to locate every data point.

Effective dimensionality is a similar concept but ED considers covariance structure.

Dimensionality reduction